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Amendments tn the Claims; 

This listing of claims will replace all prior versions and listings of claims in the instant 
application: 

T-isting of Claims! 

1. (Currently Amended) In a natural language understanding (NLU) system, a 
method for including grammars in a statistical parser comprising: 

receiving a text input; and, 

applying a first context free grammar (CFG) to said text input to determine 
substrings and corresponding parse trees, wherein said substrings and said corresponding 
parse trees further correspond to said first CFG; and, 

examining each said possible substring m A corresponding parse tree using an 
inventory of ordered grammar-related queries corresponding to said CFG , wherein said* 
q ngrire are ordered during training of th e NMJ system to form a decision tree, the 
ordering of the queries being a statistical nrdering based on a minimization of conditional 
e n tr Q pv or maximization of a likelihood th »t fl resulting model predicts data used to train 
the NLU system . 

2. (Original) The method of claim 1 , further comprising: 

comparing a probability value corresponding to each said substring to one or more 
threshold probability values, wherein said first CFG is a probabilistic CFG (PCFG). 

3. (Original) The method of claim 1, wherein said inventory of queries further 
includes: 

queries corresponding to a non-terminal within said first CFG. 
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4. (Original) The method of claim 1, wherein said inventory of queries further 
includes: 

queries corresponding to a terminal within said first CFG. 

5. (Original) The method of claim 2, wherein said inventory of queries further 
includes: 

queries corresponding to a non-terminal within said first PCFG. 

6. (Original) The method of claim 2, wherein said inventory of queries further 
includes: 

queries corresponding to a terminal within said first PCFG. 

7. (Original) The method of claim 1, further comprising iteratively applying 
different CFGs using a different CFG during each iteration to determine additional 
substrings and corresponding parse trees relating to each said different CFG applied to 
said text input. 

8. (Original) The method of claim 2, further comprising iteratively applying 
different PCFGs using a different PCFG during each iteration to determine additional 
substrings and corresponding parse trees relating to each said different PCFG applied to 
said text input. 

9. (Original) The method of claim 1, wherein said inventory of queries has a 
hierarchy determined during training of the NLU system. 
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10. (Original) The method of claim 7, further comprising the step of: 
examining each said additional substring determined by each said different CFG 

using said inventory of queries wherein said inventory of queries contains queries 
corresponding to each said different CFG. 

11. (Original) The method of claim 8, further comprising the step of: 
examining each said additional substring determined by each said different PCFG 

using said inventory of queries wherein said inventory of queries contains queries 
corresponding to each said different PCFG. 

12. (Original) The method of claim 10, wherein said inventory of queries further 
includes: 

queries corresponding to a non-terminal within each said different CFG. 

13. (Original) The method of claim 10, wherein said inventory of queries further 
includes: 

queries corresponding to a terminal within each said different CFG. 

14. (Original) The method of claim 1 1, wherein said inventory of queries further 
includes: 

queries corresponding to a non-terminal within each said different PCFG. 

15. (Original) The method of claim 11, wherein said inventory of queries further 
includes: 

queries corresponding to a terminal within each said different PCFG. 
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16. (Currently Amended) A system for recognizing grammatical phrases in a text 

input comprising: 

a text buffer for storing said text input; 

at least one context-free grammar (CFG) for recognizing a particular grammatical 
phrase within said text input; and, 

an inventory nf ordered grammar-related q ueries wherein each query within said 
inventory of queries corresponds to said at least one CFG; 

wherein said Queries are ordered durin g training of a corresponding , natural 
langua ge und erstanding (NLTI ) system to f orm a decision tree, the ordering of the queries 

a statistical ordering based on a minimization of conditional entropy or 
mavimiration nf a likelihood that a resultin g m od el predict s tfota used to train the NLU 
system; 

wherein said at least one CFG is applied to said text input in said text buffer to 
determine substrings and corresponding parse trees; 

wherein s aid inventory of queries is further applied to said substrings to determine 
said particular grammatical phrase. 

17. (Original) The system of claim 16, wherein said at least one CFG is a 
probabilistic CFG (PCFG) containing a probability value corresponding to each rule also 
within said at least one PCFG. 

1 8. (Currently Amended) A system for recognizing grammatical phrases in a text 
input comprising: 

a text buffer for storing said text input; 

at least one context-free grammar (CFG) for recognizing a particular grammatical 
phrase within said text input; and, 
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one or more weiphted grammar-related features wherein each said feature 

corresponds to said at least one CFG; 

w Wn *»ch said feature is weighte d dnring training of a corresponding , natura l 
i^fma pe under ^n^n p fNU n system, each weight being d^rmi^d based on a 
maximum e ntropy model: 

wherein said at least one CFG is applied to said text input in said text buffer to 
determine substrings and corresponding parse trees; 

wisrejiLsaid features are further applied to said substrings to determine said 
particular grammatical phrase. 

19. (Original) The system of claim 18, wherein said at least one CFG is a 
probabilistic CFG (PCFG) containing a probability value corresponding to each rule also 
within said at least one PCFG. 

20. (Currently Amended) A machine readable storage, having stored thereon a 
computer program having a plurality of code sections executable by a machine for 
causing the machine to perform the steps of: 

receiving a text input; 

applying a first context free grammar (CFG) to said text input to determine 
substrings and corresponding parse trees, wherein said substrings and said corresponding 
parse trees further correspond to said first CFG; and, 

examining each said possible substring and corresponding parse tree using an 
inventory of ordered grammar-related queries corresponding to said CF G ^ wher^m said 
mieries are ordered during t r aining of the NLU system to form a decision tree, the 
ordering of the queries beinff » statistical o r dering based on ft minimisation of conditional 
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entropy or maximization of a likelihood that a resulting model predicts data used to train 
a correspo nding NLU system. 

21. (Original) The machine readable storage of claim 20, further comprising 
iteratively applying different CFGs using a different CFG during each iteration to 
determine each possible substring and corresponding parse tree relating to each said 
different CFG applied to said text input 

22. (Original) The machine readable storage of claim 20, wherein said first CFG is 
a probabilistic CFG (PCFG) having one or more threshold probability values. 

23. (Currently Amended) The machine readable storage of claim 20, said 
inventory of queries having a hierarchy determined during training of [[an]] sajdNLU 
system. 

24. (Currently Amended) In a natural language understanding (NLU) system, a 
method for including grammars in a statistical parser comprising: 

receiving a text input; and, 

applying a first context free grammar (CFG) to said text input to determine 
substrings and corresponding parse trees, wherein said substrings and said corresponding 
pane trees further correspond to said first CFG; and, 

examining each said possible substring corresponding parse tree using one or 
more weighted grammar-related features corresponding to said CFG ^wherem , each . said 
feature is weighted during training of said N T .II system, each weight being d^rmjned 
based on a maximum entropy model. 
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25. (Original) The method of claim 24, further comprising comparing a probability 
value corresponding to each said substring to one or more threshold probability values, 
wherein said first CFG is a probabilistic CFG (PCFG). 

26. (Original) The method of claim 24, wherein said inventory of queries further 
includes: 

features corresponding to a non-terminal within said first CFG. 

27. (Original) The method of claim 24, wherein said inventory of queries further 
includes: 

features corresponding to a terminal within said first CFG. 

28. (Original) The method of claim 25, wherein said features further include: 
features corresponding to a non-terminal within said first PCFG. 

29. (Original) The method of claim 25, wherein said features further include: 
features corresponding to a terminal within said first PCFG. 

30. (Original) The method of claim 24, further comprising iteratively applying 
different CFGs using a different CFG during each iteration to determine additional 
substrings and corresponding parse trees relating to each said different CFG applied to 
said text input 

31. (Original) The method of claim 25, further comprising iteratively applying 
different PCFGs using a different PCFG during each iteration to determine additional 
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substrings and corresponding parse trees relating to each said different PCFG applied to 
said text input. 

32. (Currently Amended) The method of claim 24, wherein each sai d feature 
having-a-weight determined during training of said NLU system is determined based on 
a paneralige H iterative scaling algorithm. 

33. (Original) The method of claim 30, further comprising the step of: 
examining each said additional substring determined by each said different CFG 

using said features, wherein said features further correspond to each said different CFG. 

34. (Original) The method of claim 31, further comprising the step of: 
examining each said additional substring determined by each said different PCFG 

using said features, wherein said features further correspond to each said different PCFG. 

35. (Original) The method of claim 33, wherein said features further include: 
features corresponding to a non-terminal within each said different CFG. 

36. (Original) The method of claim 33, wherein said features further include: 
features corresponding to a terminal within each said different CFG. 

37. (Original) The method of claim 34, wherein said features further include: 
features corresponding to a non-terminal within each said different PCFG. 

38. (Original) The method of claim 34, wherein said features further include: 
features corresponding to a terminal within each said different PCFG. 
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39. (Currently Amended) A machine readable storage, having stored thereon a 
computer program having a plurality of code sections executable by a machine for 
causing the machine to perform the steps of: 

receiving a text input; 

applying a first context free grammar (CFG) to said text input to determine 
substrings and corresponding parse trees, wherein said substrings and said corresponding 
parse trees further correspond to said first CFG; and, 

examining each said possible substring and corresponding parse tree_using one or 
more ™iohtRri grammar-related features corresponding to said CF G, wherein each said 
feature is weight^ during tra inin g of a cor respon di ng n a t ural language understanding 
(NT .1 n system, each weight being deter m ined based on a maximum entropy model . 

40. (Original) The machine readable storage of claim 39, further comprising 
iteratively applying different CFGs using a different CFG during each iteration to 
determine additional substrings and corresponding parse trees relating to each said 
different CFG applied to said text input. 

41 . (Original) The machine readable storage of claim 39, wherein said first CFG is 
a probabilistic CFG (PCFG) having one or more threshold probability values. 

42. (Original) The machine readable storage of claim 39, wherein each said feature 
havings-weight determined during training of [[an]] NLU system js determined based on , 
a peneralized iterative scaling algorithm. 
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43. (Cuircntly Amended) In a natural language understanding (NLU) system, a 
direct channel method for determining a meaning for a text input comprising: 

selectably applying a reusable context free grammar (CFG) to a text input; 

identifying one or more substrings within said text input, each said substring 
corresponding to said, reusable CFG; 

examining each said possible substring and corresponding parse tree using an 
inventory of ordered grammar-related queries and a set of features corresponding to said 
PPfi, y/Win said Queries are ordered during training of the NLU system to form a 
derision tree, the ordering of the queries being a statistical ordering based on a 
mmimiratior, of conditional e ntropy or maximization of a likelihood that a resulting 
mftdfil predicts data used to train the N LU system: and, 

determining a meaning for said text input based upon said identified substrings 
from possible meanings within said reusable CFG. 

44. (Previously Presented) The method of claim 43, further comprising: 
comparing a probability value corresponding to each said substring to one or more 

threshold probability values, wherein said first reusable CFG is a reusable probabilistic 
CFG (PCFG). 

45. (Previously Presented) The method of claim 43, further comprising iteratively 
applying different selected CFGs to said text input. 

46. (Previously Presented) The method of claim 45, further comprising iteratively 
applying different selected PCFGs to said text input 
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47. (Previously Presented) The method of claim 43, said determining step 
comprising: 

applying features having weights corresponding to said substrings to said text 

input 

48. (Currently Amended) A machine readable storage, having stored thereon a 
computer program having a plurality of code sections executable by a machine for 
causing the machine to perform the steps of: 

selectably applying a reusable context free grammar (CFG) to a text input; 

identifying one or more substrings within said text input, said substrings 
corresponding to said reusable CFG; 

examining each said substring using at least one of an inventory of gyarnmar- 
related queries and a set of features corresponding to said CFG, wherein said queries aig 
ordered during training of a nmrespondtng natural language understand^ (NOT system 
to form a dec^rm tree, the nrrferin p of th e queries being a statistical ordering based on a 
minimization nf conditional entropy or m a ximisation of a likelihood that a resulting 
model predicts data used to train the N LU system: and, 

determining a meaning for said text input based upon said identified substrings 
from possible meanings within said reusable CFG. 

49. (Previously Presented) The machine readable storage of claim 48, further 
comprising: 

comparing a probability value corresponding to each said substring to one or more 
threshold probability values, wherein said first reusable CFG is a reusable probabilistic 
CFG(PCFG). 
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50. (Previously Presented) The machine readable storage of claim 48, further 
comprising iteratively applying different selected CFGs to said text input. 

51. (Previously Presented) The machine readable storage of claim 49, further 
comprising iteratively applying different selected PCFGs to said text input. 
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